Noise bridges dynamical correlation and topology in coupled oscillator networks 
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We study the relationship between dynamical properties and interaction patterns in complex oscillator net- 
works in the presence of noise. A striking finding is that noise leads to a general, one-to-one correspondence 
between the dynamical correlation and the connections among oscillators for a variety of node dynamics and 
network structures. The universal finding enables an accurate prediction of the full network topology based 
solely on measuring the dynamical correlation. The power of the method for network inference is demonstrated 
by the high success rate in identifying links for distinct dynamics on both model and real-life networks. The 
method can have potential applications in various fields due to its generality, high accuracy and efficiency. 
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Understanding the relationship between dynamics and net- 
work structure is a central issue in interdisciplinary science 
|Q1 01 • Despite the tremendous efforts in revealing the topo- 
logical effect on a variety of dynamics (3|-|5|], how to infer the 
interaction pattern from dynamical behaviors is still challeng- 
ing as an inverse problem, especially in the absence of the 
knowledge of nodal dynamics. Some methods aiming to ad- 
dress the inverse problem have been proposed, such as spike 
classification methods for measuring interactions among neu- 
rons from spike trains [6], and approaches based on response 
dynamics |7|], LI norm |8|] and noise scaling |9[]. For the in- 
verse problem, a basic question is whether sufficient topologi- 
cal information can be obtained from measured time series of 
dynamics. In this regard, the answer is negative when there is 
strong synchronization as, in this case, the coupled units be- 
have as a single oscillator and interactions among units vanish 
so that it is impossible to extract the interaction pattern from 
measurements. 

Quite surprisingly, we find that with the help of noise, in 
general it becomes possible to precisely identify interactions 
based solely on the correlations among measured time series 
of nodes. In this sense, we say that noise bridges dynamics 
and topology, facilitating inference of network structures. We 
note that noise is ubiquitous in physical and natural systems 
and understanding the noise effect on dynamical systems has 
been a fundamental issue in nonlinear and statistical physics. 
While there are recent works on the interplay between collec- 
tive dynamics and topology of complex systems under noise 
1 1 oMl 211 and on predicting node degrees for complex networks 
09|], taking advantage of noise to predict the full connecting 
topology of an unknown complex network is an outstanding 
question. Addressing this question not only is fundamental to 
nonlinear science, but also can have significant applications in 
diverse areas such as computer networks, biomedical systems, 
neuroscience, socio-economics, and defense. 

In this Letter, we present a general and powerful method 
to precisely identify links among nodes based on the noise- 



induced relationship between dynamical correlation and 
topology. Analytically, we find that there exists a one-to-one 
correspondence between the dynamical correlation matrix of 
nodal time series and the connection matrix of structures, due 
to the presence of noise. This finding enables an accurate pre- 
diction of network topology from time series. Numerical sim- 
ulations are performed using four typical dynamical systems, 
together with several model and real networks. For all cases 
examined, comparisons between the original and the predicted 
topology yield uniformly high success rate of prediction. The 
advantages of our noise-based method are then: (i) high ac- 
curacy and efficiency, (ii) generality with respect to node dy- 
namics and network structures, (iii) no need for control, and 
(iv) applicability even when there is weak coherence in the 
collective dynamics. 

Our general approach to bridging dynamical correlation 
and topology is, as follows. We consider N nonidentical os- 
cillators, each of which satisfies Xj = Fj(xi) in the absence 
of coupling, where Xj denotes the d-dimensional state variable 
of the ith oscillator. Under noise, the dynamics of the whole 
coupled-oscillator system can be expressed as: 



Fi(x< 



N 

c}^LijH(-Xj) + rn, 



(1) 



R d -> R d denotes 
is the noise term, 
and 



where c is the coupling strength, H : 
the coupling function of oscillators, rj t 
Lij = — 1 if j connects to i (otherwise 0) for i ^ j 

La = — Z~2jLi jjti Lij- Due to nonidentical oscillators and 
noise, an invariant synchronization manifold does not exist. 
Let Xj be the counterpart of Xj in the absence of noise, and 
assume a small perturbation £j, we can write x,; = Xj + £j. 
Substituting this into Eq. (Q~|), we obtain: 



i = [.DF(x) - cL <g> DH(x)]{ + f), 



(2) 



where £ = £2, • ■ • > £n] T denotes the deviation vec- 
tor, 77 = [771, i]2, ■ ■ ■ , t!n] T is the noise vector, L names 
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the Laplacian matrix of coupling {Lij}, DF(x) = 

diag[DPi(xi) ) Df , 2 (xa) s --- ,DF N (x N )} (DF t are d x d 
Jacobian matrices of F^), ® denotes direct product, and _DH 
is the Jacobian matrix of the coupling function H. 

Denoting the dynamical correlation of oscillators (££ T ) as 
and (■) is time average, we have 



C, wherein Cy = 

= (d(tf T )/dt) = - 



AC-CA T + (,f) + (^), (3) 



where A = -DF(x) + cL ® DH(x). To obtain the ex- 
pression of (?7^ T ) and (£n T ), we get the solution £(t) from 
Eq. ©: £(t) = G(t - to)£(t ) + / t * dt'G(t - t'M*'), 
where G(t) = exp(— At). In the absence of divergence of 
state variables, G(oo) = 0. Setting to — > — oo, without 
loss of generality, we have £(t) = J_ G(t — t')rj(t')dt' . 
Note that G(0) = I, we hence obtain (£t? t ) = f ^ G(t - 
t'){r,(t)v T (t'))dt' = J^Git - t')t)S(t ~ t')dt /0< L D/2, 

where D is the covariance matrix of noise. Analogously, we 
can obtain (?y£ T ) = D/2. Therefore, Eq. (0 can be simplified 
to: 



AC + CA T = D. 



(4) 



Since A = — DF(x) + cL ® £)H(x), the above equality re- 
veals a general relationship between the dynamical correlation 
C and the connecting matrix L in the presence of noise as 
characterized by D. The general solution of C can be written 
as vec(C) = vec(D)/(i ® A + A ® I), where vec(X) is a 
vector containing all columns of matrix X 11311 . 

For illustrative purpose, we consider one-dimensional state 
variable and linear coupling such that Dfl = 1, with Gaus- 
sian white noise D = er 2 I, and further regard the intrinsic 
dynamics DF as small perturbations. Then Eq. (O can be 
simplified to LC + CL T = er 2 I/c. For an undirected net- 
work with symmetric coupling matrix, the solution of C can 
be expressed as: 



2c ' 



(5) 



where Jj denotes the pseudo inverse of the Laplacian ma- 
trix. We note that the dynamic correlation matrix C is closely 
related to the network connection matrix L, which can be 
used to infer network structures when no knowledge about the 
nodal dynamics is available. In fact, C acts as the "Green's 
function" of the network and can be expressed as some kind 
of path integral associated with the underlying network topol- 
ogy (see 114I0 . as follows: 
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(6) 



where path means all paths from j to i, and m denotes the 
nodes on them. This path-integral representation is extremely 
useful for revealing the direct relation between autocorrela- 
tion Ca in the matrix C and the local structure fc,. In partic- 
ular, for nth-order approximation, we count all paths whose 
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FIG. 1: (Color online) Distribution of the values of [a 2 /{2c)\C\ j , 
where are the elements in the pseudo inverse matrix of the dy- 
namical correlation matrix C. Consensus dynamics [ 15] are used for 
(a) random (2lll . (b) small- world (22ll . (c) scale-free model networks 
l23ll and three real- world networks: (d) friendship network of karate 
club l25ll . (e) network of American football games among colleges 
l26ll and (f) the neural network of C. Elegans I22I1 . The theoretical 
threshold [cr 2 /(2c)]C| f is marked by red dashed lines. The sizes of 
model networks are all 500. For random networks, the connection 
probability among nodes is 0.024. For scale-free networks the mini- 
mum degree is k m i n = 6. For small-world networks, (k) = 12 and 
the rewiring probability is 0.1. 



lengths are equal to or less than n. Under second-order ap- 
proximation, we have 



c - = — (- + — Y, -) ~ — 

2c I ki k^ p i kg J 2cfcj 
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where mean-field approximation is applied and Ti denote the 
neighbors of node i. This dependence of the autocorrelation 
Ca on the degree ki, under the second-order approximation 
is consistent with the recently discovered noise-induced alge- 
braic scaling law in Ref. (9D, derived there by a power-spectral 
analysis. 

To provide numerical support for the validity and generality 
of our theoretical results on the relationship between dynami- 
cal correlation and topology, we consider a number of model 
and real-world network structures by using four typical dy- 
namical systems, as follows, (i) Consensus dynamics 11511 : 
Xi = c J~lj—i Pij (xj — Xi) + r\i\ (ii) Identical Rossler dynam- 
ics d (I-Rossler): 
iji = x, t +0.2y 



(N-R6ssler): Xi 

y, = bJiXi + 0.2yi + c ^"=1 P n (v. 



%t — y% Zi 

N 




I±1 Pij(' 



-Vi 



0.2+^(^-9.0)+ 
); (iii) Nonidentical Rossler dynamics lfl7tl 

Xi) + rji, 



Zi + c 



ELM*. 



N 



j/i), ii = 0.2 + Zi(xi 
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TABLE I: Success rates of existent links (SREL) and of non-existent 
links (SRNL) |H with our method for (i) Consensus, (ii) I-R6ssler, 
(iii) N-R6ssler, and (iv) Kuramoto dynamics on random 12111 ■ small- 
world 1 22] , scale-free model networks [23], and six real-world net- 
works: network of political book purc hases (Book) l24ll . friendship 
network of karate club (Karate) 1 25], network of American foot- 
ball games among colleges (Football) 1 26] , electric circuit networks 
(Elec. Cir.) 12711 . dolphin social network (Dolphins) 1 28] , and the 
neural network of C. Elegans (C. Elegans) [22] . The noise strength 
is a 2 = 2. For the non-identical Rossler system, lo — [0.8, 1.2] 
and for the Kuramoto dynamics, u) = [0, 0.2]. Other parameters of 
model networks are the same as Fig.Q] 



SREL/SRNL 


consensus 


I-Rossler 


N-R6ssler 


Kuramoto 


Random 


1.00/1.00 


1.00/1.00 


0.995/1.00 


0.977/0.999 


Small-world 


0.993/1.00 


0.988/1.00 


0.979/1.00 


0.982/1.00 


Scale-free 


0.995/1.00 


0.990/1.00 


0.980/1.00 


0.978/1.00 


Book 


0.971/1.00 


0.977/1.00 


0.964/1.00 


0.967/1.00 


Karate 


0.962/1.00 


0.962/1.00 


0.936/1.00 


0.949/1.00 


Football 


0.938/1.00 


0.932/1.00 


0.928/1.00 


0.927/1.00 


Elec. Cir. 


0.976/1.00 


0.973/1.00 


0.971/1.00 


0.965/1.00 


Dolphins 


0.984/1.00 


0.981/1.00 


0.984/1.00 


0.973/1.00 


C. Elegans 


1.00/0.997 


1.00/0.996 


1.00/0.997 


0.993/0.997 



TABLE II: SREL with our method for consensus and N-R6ssler dy- 
namics on random, small-world, scale-free networks with different 
average degree (k). SRNL for all cases are 1.000 (not shown). Pa- 
rameters are the same as Table U 



SREL 


consensus 


N-R6ssler 


(fc) 


8 10 12 


8 10 12 


Random 


0.986 0.993 0.996 


0.975 0.984 0.989 


Small-world 


0.952 0.977 0.993 


0.935 0.966 0.977 


Scale-free 


0.986 0.995 0.997 


0.964 0.980 0.987 



9.0) + c YljLi Pij i z j ~ z i)> where governs the natural fre- 
quency of an individual oscillator i and is randomly chosen 
from a range [01,02]; (iv) Kuramoto phase oscillators 11811 : 
9i = Loi + cY^ =1 Pij sin (#j — 9i) + r]i, where 9i and a;, are 
the phase and natural frequency of node i. 

Numerical simulations are carried out to predict the entire 
network structure based solely on time series, utilizing the 
one-to-one correspondence between the dynamical correla- 
tion and Laplacian matrix of topology. From Eq. Q, we have 
L = [a 2 /(2c)]&, where L contains full information about 
the network topology, and is the pseudo inverse. The ma- 



trix C can be obtained from time series a.s CV 



x(i)] • [ Xi (t) - x(i)]}, where x(t) = (1/JV) £ti x,(i). Far 
Kuramoto oscillators, x;(t) denotes the phase variable 6(t) 
and for the Rossler dynamics, x^ (t) is the x component of the 
ith oscillator 11911 . After C is constructed, we are able to ob- 
tain L through the pseudo inverse. 



(Mi) 



FigureQ]shows the distribution of elements of [a 2 / (2c)] & . 
We observe a bimodal distribution with one peak centered at 
— 1 corresponding to existent links and the other peak cen- 
tered at zero corresponding to zero elements in L. There 
are also some positive values in the distribution that dis- 
perse on the right side of the peak about zero, which are 
due to the diagonal components in L. We focus on non- 
diagonal elements in L. If L were reconstructed perfectly 
from [a 2 / (2c)]& , the two peaks would be very sharp. A 
threshold can be set to distinguish existent from non-existent 
links by using Eq. 0. In particular, from Eq. we have 
S = Eti VCh = 2cl 2 /[a 2 {N + I)}, where I = £^1 h = 
N (k) is twice the total number of links. We can calculate I 
through I = (Sa 2 
tegral part. 



8cNSa 2 ) /4c and keep its in- 
We then rank all elements of the matrix (or 
matrix [a 2 / '(2c)] Cl) in an ascending order. For convenience, 
we denote the ascending-ordered matrix elements by C^, for 
m = 1, . . . , N 2 . The threshold C ] M (or [a 2 / (2c)}C\ I ) is cho- 
sen such that Ylm=i ^K^m) = where $(C^) is the unnor- 
malized distribution of C,J„. This means the rank of C\f is I 
in the queue of ascending-ordered matrix elements Cj,. Then 
the connection matrix can be obtained by setting all elements 
in & with values above the threshold C\ f to be zero and oth- 
ers to be —1, the latter corresponding to existent links. As 
shown in Fig.Q] for different model and real-world networks, 
thresholds so determined are able to successfully separate the 
two peaks in the distributions of elements of C^, which in 
turn leads to predictions of links with high success rates for 
various node dynamics, as displayed in Table U Alternatively, 
the threshold can be empirically determined by the largest gap 
between the two peaks, and we have obtained essentially the 
same success rates. Table ITT1 exemplifies the success rates of 
our method for different values of the average degree (fc) for 
different types of networks. We see that the success rate in- 
creases with (k). 

For directed networks, there is no unique solution for L 
from C, because the asymmetric L has a twofold degree of 
freedom as that of symmetric C. Thus, the global structure 
of directed networks cannot be inferred solely depending on 
the correlation. However, Eq. (|7]l is satisfied by replacing node 
degree with in-degree, so that we still can infer the local struc- 
ture, the in-degree of each node, through k\ n ~ C# . As 
shown in Fig. [2] theory agrees well with numerical results. 

In conclusion, we have discovered a general relation be- 
tween the dynamical correlation among oscillators and the un- 
derlying topology in the presence of noise. The correlation 
matrix is inversely proportional to the Laplacian matrix that 
contains full information about the network structure. Recon- 
struction of the full network topology based on time series 
then becomes possible, particularly for undirected networks. 
We have provided strong numerical support by using four 
types of nodal dynamics together with several model and real- 
world network structures. We find that the full network topol- 
ogy can be predicted with high success rate and efficiency for 
all considered cases. Besides high success rates, advantages 
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FIG. 2: (Color online) Ca as a function of node in-degree ki n for 
different node dynamics for directed networks where each link is 
assigned a random direction, and A = cr 2 (l + l/(fc))/2c. Other net- 
work parameters are the same as in Fig.Q] The lines are predictions 
from Eq. Q. 



making our method attractive and powerful include generality 
for a variety of nodal dynamics and network structures, va- 
lidity in the existence of weak coherence, applicability in the 
absence of knowledge about nodal dynamics, and no need to 
control nodal dynamics as in some existing method. We hope 
that our method can be widely applied for inferring network 
structures and inspire further research towards the understand- 
ing of noise effects on networked dynamical systems. 

We thank anonymous referees for valuable suggestions on 
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supported by AFOSR under Grant No. FA9550-07- 1-0045. 
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